Papers with transfer learning setting
A Dataset of Offensive Language in Kosovo Social Media (2022.lrec-1)
Copied to clipboard
| Challenge: | Social media are a central part of people’s lives but are rife with bullying and offensive language, creating an unsafe environment for their users. |
| Approach: | They propose to use user-generated comments on Facebook and YouTube from selected Kosovo news platforms to annotate offensive language in Albanian. |
| Outcome: | The proposed system improves on Danish but not Albanian, on offensive language recognition and distinguishing targeted and untargeted offence. |
Convolutional Neural Network for Universal Sentence Embeddings (C18-1)
Copied to clipboard
| Challenge: | Recent studies show that averaging word embeddings is effective for NLP but these models represent a sentence only in terms of features of words or uni-grams. |
| Approach: | They propose a CNN-based model that uses both features of words and n-grams to encode sentences. |
| Outcome: | The proposed model performs better than existing models in transfer learning setting and exceeds state of the art in supervised learning setting by initializing the parameters with the pre-trained sentence embeddings. |
Task-Aware Representation of Sentences for Generic Text Classification (2020.coling-main)
Copied to clipboard
| Challenge: | Existing approaches to text classification use a transformer architecture with a linear layer on top. |
| Approach: | They propose a transformer-based approach that outputs a class distribution for a given prediction problem. |
| Outcome: | The proposed model outperforms existing approaches on small training data and can learn to predict new classes even with no training examples. |